Twin Contrastive Learning for Online Clustering
نویسندگان
چکیده
This paper proposes to perform online clustering by conducting twin contrastive learning (TCL) at the instance and cluster level. Specifically, we find that when data is projected into a feature space with dimensionality of target number, rows columns its matrix correspond representation, respectively. Based on observation, for given dataset, proposed TCL first constructs positive negative pairs through augmentations. Thereafter, in row column matrix, instance- cluster-level are respectively conducted pulling together while pushing apart negatives. To alleviate influence intrinsic false-negative rectify assignments, adopt confidence-based criterion select pseudo-labels boosting both learning. As result, performance further improved. Besides elegant idea learning, another advantage it could independently predict assignment each instance, thus effortlessly fitting scenarios. Extensive experiments six widely-used image text benchmarks demonstrate effectiveness TCL. The code released https://pengxi.me .
منابع مشابه
Online learning for audio clustering and segmentation
Audio segmentation is an essential problem in many audio signal processing tasks which tries to segment an audio signal into homogeneous chunks, or segments. Most current approaches rely on a change-point detection phase for finding segment boundaries, followed by a similarity matching phase which identifies similar segments. In this thesis, we focus instead on joint segmentation and clustering...
متن کاملTwin Vector Machines for Online Learning on a Budget
This paper proposes Twin Vector Machine (TVM), a constant space and sublinear time Support Vector Machine (SVM) algorithm for online learning. TVM achieves its favorable scaling by maintaining only a fixed number of examples, called the twin vectors, and their associated information in memory during training. In addition, TVM guarantees that Kuhn-Tucker conditions are satisfied on all twin vect...
متن کاملContrastive Learning for Image Captioning
Image captioning, a popular topic in computer vision, has achieved substantial progress in recent years. However, the distinctiveness of natural descriptions is often overlooked in previous work. It is closely related to the quality of captions, as distinctive captions are more likely to describe images with their unique aspects. In this work, we propose a new learning method, Contrastive Learn...
متن کاملOn Contrastive Divergence Learning
Maximum-likelihood (ML) learning of Markov random fields is challenging because it requires estimates of averages that have an exponential number of terms. Markov chain Monte Carlo methods typically take a long time to converge on unbiased estimates, but Hinton (2002) showed that if the Markov chain is only run for a few steps, the learning can still work well and it approximately minimizes a d...
متن کاملA Reinforcement Learning Approach to Online Clustering
A general technique is proposed for embedding online clustering algorithms based on competitive learning in a reinforcement learning framework. The basic idea is that the clustering system can be viewed as a reinforcement learning system that learns through reinforcements to follow the clustering strategy we wish to implement. In this sense, the reinforcement guided competitive learning (RGCL) ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Computer Vision
سال: 2022
ISSN: ['0920-5691', '1573-1405']
DOI: https://doi.org/10.1007/s11263-022-01639-z